Results of the French Evalda-Media evaluation campaign for literal understanding
Identifieur interne : 005113 ( Main/Exploration ); précédent : 005112; suivant : 005114Results of the French Evalda-Media evaluation campaign for literal understanding
Auteurs : H. Bonneau-Maynard [France] ; C. Ayache [France] ; F. Bechet [France] ; Alexandre Denis [France] ; A. Kuhn [France] ; F. Lefevre [France] ; D. Mostefa [France] ; M. Quignard [France] ; S. Rosset [France] ; Christophe Servan [France] ; J. Villaneau [France]Source :
English descriptors
Abstract
The aim of the MEDIA-EVALDA project is to evaluate the understanding capabilities of dialog systems. This paper presents the MEDIA protocol for speech understanding evaluation and describes the results of the June 2005 literal evaluation campaign. Five systems, both symbolic or corpus-based participated to the evaluation which is based on a common semantic representation. Different scorings have been performed on the system results. The understanding error rate, for the Full scoring is, depending on the systems, from 29% to 41.3%. A diagnosis analysis of these results is proposed.
Url:
Affiliations:
- France
- Grand Est, Lorraine (région), Provence-Alpes-Côte d'Azur, Région Bretagne
- Avignon, Lorient, Metz, Nancy
- Université d'Avignon, Université de Bretagne-Sud, Université de Lorraine, Université européenne de Bretagne
Links toward previous steps (curation, corpus...)
- to stream Hal, to step Corpus: 004176
- to stream Hal, to step Curation: 004176
- to stream Hal, to step Checkpoint: 004049
- to stream Main, to step Merge: 005279
- to stream Main, to step Curation: 005113
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Results of the French Evalda-Media evaluation campaign for literal understanding</title><author><name sortKey="Bonneau Maynard, H" sort="Bonneau Maynard, H" uniqKey="Bonneau Maynard H" first="H" last="Bonneau-Maynard">H. Bonneau-Maynard</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202" status="OLD"><orgName>Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [Orsay]</orgName><orgName type="acronym">LIMSI</orgName><desc><address><addrLine>Université Paris Sud (Paris XI) Bât. 508 BP 133 91403 ORSAY CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.limsi.fr/</ref></desc><listRelation><relation name="UPR3251" active="#struct-441569" type="direct"></relation><relation active="#struct-92966" type="direct"></relation><relation active="#struct-93591" type="direct"></relation></listRelation><tutelles><tutelle name="UPR3251" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-92966" type="direct"><org type="institution" xml:id="struct-92966" status="VALID"><orgName>Université Paris-Sud - Paris 11</orgName><orgName type="acronym">UP11</orgName><desc><address><addrLine>Bâtiment 300 - 91405 Orsay cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.u-psud.fr/</ref></desc></org></tutelle><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Ayache, C" sort="Ayache, C" uniqKey="Ayache C" first="C" last="Ayache">C. Ayache</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-7889" status="VALID"><orgName>Evaluations and Language resources Distribution Agency</orgName><orgName type="acronym">ELDA</orgName><desc><address><addrLine>ELDA 55-57 rue Brillat Savarin 75013 Paris France</addrLine><country key="FR"></country></address><ref type="url">http://www.elda.org</ref></desc><listRelation><relation active="#struct-365059" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-365059" type="direct"><org type="institution" xml:id="struct-365059" status="INCOMING"><orgName>ELDA</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Bechet, F" sort="Bechet, F" uniqKey="Bechet F" first="F" last="Bechet">F. Bechet</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-100376" status="VALID"><orgName>Laboratoire Informatique d'Avignon</orgName><orgName type="acronym">LIA</orgName><desc><address><addrLine>339 Chemin des Meinajaries Agroparc BP 1228 84911 Avignon cedex 9</addrLine><country key="FR"></country></address><ref type="url">http://lia.univ-avignon.fr/</ref></desc><listRelation><relation active="#struct-195507" type="direct"></relation><relation active="#struct-302221" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-195507" type="direct"><org type="institution" xml:id="struct-195507" status="VALID"><orgName>Université d'Avignon et des Pays de Vaucluse</orgName><orgName type="acronym">UAPV</orgName><desc><address><addrLine>74 rue Louis Pasteur - 84 029 Avignon cedex 1</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-avignon.fr/</ref></desc></org></tutelle><tutelle active="#struct-302221" type="direct"><org type="institution" xml:id="struct-302221" status="VALID"><orgName>Centre d'Enseignement et de Recherche en Informatique - CERI</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Avignon</settlement><region type="region" nuts="2">Provence-Alpes-Côte d'Azur</region></placeName><orgName type="university">Université d'Avignon</orgName></affiliation></author><author><name sortKey="Denis, Alexandre" sort="Denis, Alexandre" uniqKey="Denis A" first="Alexandre" last="Denis">Alexandre Denis</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-178243" status="VALID"><orgName>Natural Language Processing : representations, inference and semantics </orgName><orgName type="acronym">SYNALP</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/equipes/synalp</ref></desc><listRelation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author><author><name sortKey="Kuhn, A" sort="Kuhn, A" uniqKey="Kuhn A" first="A" last="Kuhn">A. Kuhn</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-7889" status="VALID"><orgName>Evaluations and Language resources Distribution Agency</orgName><orgName type="acronym">ELDA</orgName><desc><address><addrLine>ELDA 55-57 rue Brillat Savarin 75013 Paris France</addrLine><country key="FR"></country></address><ref type="url">http://www.elda.org</ref></desc><listRelation><relation active="#struct-365059" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-365059" type="direct"><org type="institution" xml:id="struct-365059" status="INCOMING"><orgName>ELDA</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Lefevre, F" sort="Lefevre, F" uniqKey="Lefevre F" first="F" last="Lefevre">F. Lefevre</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202" status="OLD"><orgName>Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [Orsay]</orgName><orgName type="acronym">LIMSI</orgName><desc><address><addrLine>Université Paris Sud (Paris XI) Bât. 508 BP 133 91403 ORSAY CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.limsi.fr/</ref></desc><listRelation><relation name="UPR3251" active="#struct-441569" type="direct"></relation><relation active="#struct-92966" type="direct"></relation><relation active="#struct-93591" type="direct"></relation></listRelation><tutelles><tutelle name="UPR3251" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-92966" type="direct"><org type="institution" xml:id="struct-92966" status="VALID"><orgName>Université Paris-Sud - Paris 11</orgName><orgName type="acronym">UP11</orgName><desc><address><addrLine>Bâtiment 300 - 91405 Orsay cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.u-psud.fr/</ref></desc></org></tutelle><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Mostefa, D" sort="Mostefa, D" uniqKey="Mostefa D" first="D" last="Mostefa">D. Mostefa</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-7889" status="VALID"><orgName>Evaluations and Language resources Distribution Agency</orgName><orgName type="acronym">ELDA</orgName><desc><address><addrLine>ELDA 55-57 rue Brillat Savarin 75013 Paris France</addrLine><country key="FR"></country></address><ref type="url">http://www.elda.org</ref></desc><listRelation><relation active="#struct-365059" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-365059" type="direct"><org type="institution" xml:id="struct-365059" status="INCOMING"><orgName>ELDA</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Quignard, M" sort="Quignard, M" uniqKey="Quignard M" first="M" last="Quignard">M. Quignard</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-178243" status="VALID"><orgName>Natural Language Processing : representations, inference and semantics </orgName><orgName type="acronym">SYNALP</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/equipes/synalp</ref></desc><listRelation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author><author><name sortKey="Rosset, S" sort="Rosset, S" uniqKey="Rosset S" first="S" last="Rosset">S. Rosset</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202" status="OLD"><orgName>Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [Orsay]</orgName><orgName type="acronym">LIMSI</orgName><desc><address><addrLine>Université Paris Sud (Paris XI) Bât. 508 BP 133 91403 ORSAY CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.limsi.fr/</ref></desc><listRelation><relation name="UPR3251" active="#struct-441569" type="direct"></relation><relation active="#struct-92966" type="direct"></relation><relation active="#struct-93591" type="direct"></relation></listRelation><tutelles><tutelle name="UPR3251" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-92966" type="direct"><org type="institution" xml:id="struct-92966" status="VALID"><orgName>Université Paris-Sud - Paris 11</orgName><orgName type="acronym">UP11</orgName><desc><address><addrLine>Bâtiment 300 - 91405 Orsay cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.u-psud.fr/</ref></desc></org></tutelle><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Servan, Christophe" sort="Servan, Christophe" uniqKey="Servan C" first="Christophe" last="Servan">Christophe Servan</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-100376" status="VALID"><orgName>Laboratoire Informatique d'Avignon</orgName><orgName type="acronym">LIA</orgName><desc><address><addrLine>339 Chemin des Meinajaries Agroparc BP 1228 84911 Avignon cedex 9</addrLine><country key="FR"></country></address><ref type="url">http://lia.univ-avignon.fr/</ref></desc><listRelation><relation active="#struct-195507" type="direct"></relation><relation active="#struct-302221" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-195507" type="direct"><org type="institution" xml:id="struct-195507" status="VALID"><orgName>Université d'Avignon et des Pays de Vaucluse</orgName><orgName type="acronym">UAPV</orgName><desc><address><addrLine>74 rue Louis Pasteur - 84 029 Avignon cedex 1</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-avignon.fr/</ref></desc></org></tutelle><tutelle active="#struct-302221" type="direct"><org type="institution" xml:id="struct-302221" status="VALID"><orgName>Centre d'Enseignement et de Recherche en Informatique - CERI</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Avignon</settlement><region type="region" nuts="2">Provence-Alpes-Côte d'Azur</region></placeName><orgName type="university">Université d'Avignon</orgName></affiliation></author><author><name sortKey="Villaneau, J" sort="Villaneau, J" uniqKey="Villaneau J" first="J" last="Villaneau">J. Villaneau</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-203132" status="VALID"><orgName>SEASIDE</orgName><orgName type="acronym">IRISA - UBS</orgName><desc><address><addrLine>IRISA, Université de Bretagne-Sud, Campus de Tohannic, 56017 Vannes</addrLine><country key="FR"></country></address><ref type="url">http://www-irisa.univ-ubs.fr/SEASIDE/</ref></desc><listRelation><relation active="#struct-172265" type="direct"></relation><relation name="UMR6074" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-172265" type="direct"><org type="institution" xml:id="struct-172265" status="VALID"><orgName>Université de Bretagne Sud</orgName><orgName type="acronym">UBS</orgName><desc><address><addrLine>BP 92116 - 56321 Lorient cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-ubs.fr/</ref></desc></org></tutelle><tutelle name="UMR6074" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Lorient</settlement><region type="region" nuts="2">Région Bretagne</region></placeName><orgName type="university">Université de Bretagne-Sud</orgName><orgName type="institution" wicri:auto="newGroup">Université européenne de Bretagne</orgName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:hal-01160167</idno><idno type="halId">hal-01160167</idno><idno type="halUri">https://hal.archives-ouvertes.fr/hal-01160167</idno><idno type="url">https://hal.archives-ouvertes.fr/hal-01160167</idno><date when="2006-05-24">2006-05-24</date><idno type="wicri:Area/Hal/Corpus">004176</idno><idno type="wicri:Area/Hal/Curation">004176</idno><idno type="wicri:Area/Hal/Checkpoint">004049</idno><idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">004049</idno><idno type="wicri:Area/Main/Merge">005279</idno><idno type="wicri:Area/Main/Curation">005113</idno><idno type="wicri:Area/Main/Exploration">005113</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">Results of the French Evalda-Media evaluation campaign for literal understanding</title><author><name sortKey="Bonneau Maynard, H" sort="Bonneau Maynard, H" uniqKey="Bonneau Maynard H" first="H" last="Bonneau-Maynard">H. Bonneau-Maynard</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202" status="OLD"><orgName>Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [Orsay]</orgName><orgName type="acronym">LIMSI</orgName><desc><address><addrLine>Université Paris Sud (Paris XI) Bât. 508 BP 133 91403 ORSAY CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.limsi.fr/</ref></desc><listRelation><relation name="UPR3251" active="#struct-441569" type="direct"></relation><relation active="#struct-92966" type="direct"></relation><relation active="#struct-93591" type="direct"></relation></listRelation><tutelles><tutelle name="UPR3251" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-92966" type="direct"><org type="institution" xml:id="struct-92966" status="VALID"><orgName>Université Paris-Sud - Paris 11</orgName><orgName type="acronym">UP11</orgName><desc><address><addrLine>Bâtiment 300 - 91405 Orsay cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.u-psud.fr/</ref></desc></org></tutelle><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Ayache, C" sort="Ayache, C" uniqKey="Ayache C" first="C" last="Ayache">C. Ayache</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-7889" status="VALID"><orgName>Evaluations and Language resources Distribution Agency</orgName><orgName type="acronym">ELDA</orgName><desc><address><addrLine>ELDA 55-57 rue Brillat Savarin 75013 Paris France</addrLine><country key="FR"></country></address><ref type="url">http://www.elda.org</ref></desc><listRelation><relation active="#struct-365059" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-365059" type="direct"><org type="institution" xml:id="struct-365059" status="INCOMING"><orgName>ELDA</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Bechet, F" sort="Bechet, F" uniqKey="Bechet F" first="F" last="Bechet">F. Bechet</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-100376" status="VALID"><orgName>Laboratoire Informatique d'Avignon</orgName><orgName type="acronym">LIA</orgName><desc><address><addrLine>339 Chemin des Meinajaries Agroparc BP 1228 84911 Avignon cedex 9</addrLine><country key="FR"></country></address><ref type="url">http://lia.univ-avignon.fr/</ref></desc><listRelation><relation active="#struct-195507" type="direct"></relation><relation active="#struct-302221" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-195507" type="direct"><org type="institution" xml:id="struct-195507" status="VALID"><orgName>Université d'Avignon et des Pays de Vaucluse</orgName><orgName type="acronym">UAPV</orgName><desc><address><addrLine>74 rue Louis Pasteur - 84 029 Avignon cedex 1</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-avignon.fr/</ref></desc></org></tutelle><tutelle active="#struct-302221" type="direct"><org type="institution" xml:id="struct-302221" status="VALID"><orgName>Centre d'Enseignement et de Recherche en Informatique - CERI</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Avignon</settlement><region type="region" nuts="2">Provence-Alpes-Côte d'Azur</region></placeName><orgName type="university">Université d'Avignon</orgName></affiliation></author><author><name sortKey="Denis, Alexandre" sort="Denis, Alexandre" uniqKey="Denis A" first="Alexandre" last="Denis">Alexandre Denis</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-178243" status="VALID"><orgName>Natural Language Processing : representations, inference and semantics </orgName><orgName type="acronym">SYNALP</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/equipes/synalp</ref></desc><listRelation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author><author><name sortKey="Kuhn, A" sort="Kuhn, A" uniqKey="Kuhn A" first="A" last="Kuhn">A. Kuhn</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-7889" status="VALID"><orgName>Evaluations and Language resources Distribution Agency</orgName><orgName type="acronym">ELDA</orgName><desc><address><addrLine>ELDA 55-57 rue Brillat Savarin 75013 Paris France</addrLine><country key="FR"></country></address><ref type="url">http://www.elda.org</ref></desc><listRelation><relation active="#struct-365059" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-365059" type="direct"><org type="institution" xml:id="struct-365059" status="INCOMING"><orgName>ELDA</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Lefevre, F" sort="Lefevre, F" uniqKey="Lefevre F" first="F" last="Lefevre">F. Lefevre</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202" status="OLD"><orgName>Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [Orsay]</orgName><orgName type="acronym">LIMSI</orgName><desc><address><addrLine>Université Paris Sud (Paris XI) Bât. 508 BP 133 91403 ORSAY CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.limsi.fr/</ref></desc><listRelation><relation name="UPR3251" active="#struct-441569" type="direct"></relation><relation active="#struct-92966" type="direct"></relation><relation active="#struct-93591" type="direct"></relation></listRelation><tutelles><tutelle name="UPR3251" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-92966" type="direct"><org type="institution" xml:id="struct-92966" status="VALID"><orgName>Université Paris-Sud - Paris 11</orgName><orgName type="acronym">UP11</orgName><desc><address><addrLine>Bâtiment 300 - 91405 Orsay cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.u-psud.fr/</ref></desc></org></tutelle><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Mostefa, D" sort="Mostefa, D" uniqKey="Mostefa D" first="D" last="Mostefa">D. Mostefa</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-7889" status="VALID"><orgName>Evaluations and Language resources Distribution Agency</orgName><orgName type="acronym">ELDA</orgName><desc><address><addrLine>ELDA 55-57 rue Brillat Savarin 75013 Paris France</addrLine><country key="FR"></country></address><ref type="url">http://www.elda.org</ref></desc><listRelation><relation active="#struct-365059" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-365059" type="direct"><org type="institution" xml:id="struct-365059" status="INCOMING"><orgName>ELDA</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Quignard, M" sort="Quignard, M" uniqKey="Quignard M" first="M" last="Quignard">M. Quignard</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-178243" status="VALID"><orgName>Natural Language Processing : representations, inference and semantics </orgName><orgName type="acronym">SYNALP</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/equipes/synalp</ref></desc><listRelation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author><author><name sortKey="Rosset, S" sort="Rosset, S" uniqKey="Rosset S" first="S" last="Rosset">S. Rosset</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202" status="OLD"><orgName>Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [Orsay]</orgName><orgName type="acronym">LIMSI</orgName><desc><address><addrLine>Université Paris Sud (Paris XI) Bât. 508 BP 133 91403 ORSAY CEDEX</addrLine><country key="FR"></country></address><ref type="url">http://www.limsi.fr/</ref></desc><listRelation><relation name="UPR3251" active="#struct-441569" type="direct"></relation><relation active="#struct-92966" type="direct"></relation><relation active="#struct-93591" type="direct"></relation></listRelation><tutelles><tutelle name="UPR3251" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle><tutelle active="#struct-92966" type="direct"><org type="institution" xml:id="struct-92966" status="VALID"><orgName>Université Paris-Sud - Paris 11</orgName><orgName type="acronym">UP11</orgName><desc><address><addrLine>Bâtiment 300 - 91405 Orsay cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.u-psud.fr/</ref></desc></org></tutelle><tutelle active="#struct-93591" type="direct"><org type="institution" xml:id="struct-93591" status="VALID"><orgName>Université Pierre et Marie Curie - Paris 6</orgName><orgName type="acronym">UPMC</orgName><desc><address><addrLine>4 place Jussieu - 75005 Paris</addrLine><country key="FR"></country></address><ref type="url">http://www.upmc.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country></affiliation></author><author><name sortKey="Servan, Christophe" sort="Servan, Christophe" uniqKey="Servan C" first="Christophe" last="Servan">Christophe Servan</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-100376" status="VALID"><orgName>Laboratoire Informatique d'Avignon</orgName><orgName type="acronym">LIA</orgName><desc><address><addrLine>339 Chemin des Meinajaries Agroparc BP 1228 84911 Avignon cedex 9</addrLine><country key="FR"></country></address><ref type="url">http://lia.univ-avignon.fr/</ref></desc><listRelation><relation active="#struct-195507" type="direct"></relation><relation active="#struct-302221" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-195507" type="direct"><org type="institution" xml:id="struct-195507" status="VALID"><orgName>Université d'Avignon et des Pays de Vaucluse</orgName><orgName type="acronym">UAPV</orgName><desc><address><addrLine>74 rue Louis Pasteur - 84 029 Avignon cedex 1</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-avignon.fr/</ref></desc></org></tutelle><tutelle active="#struct-302221" type="direct"><org type="institution" xml:id="struct-302221" status="VALID"><orgName>Centre d'Enseignement et de Recherche en Informatique - CERI</orgName><desc><address><country key="FR"></country></address></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Avignon</settlement><region type="region" nuts="2">Provence-Alpes-Côte d'Azur</region></placeName><orgName type="university">Université d'Avignon</orgName></affiliation></author><author><name sortKey="Villaneau, J" sort="Villaneau, J" uniqKey="Villaneau J" first="J" last="Villaneau">J. Villaneau</name><affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-203132" status="VALID"><orgName>SEASIDE</orgName><orgName type="acronym">IRISA - UBS</orgName><desc><address><addrLine>IRISA, Université de Bretagne-Sud, Campus de Tohannic, 56017 Vannes</addrLine><country key="FR"></country></address><ref type="url">http://www-irisa.univ-ubs.fr/SEASIDE/</ref></desc><listRelation><relation active="#struct-172265" type="direct"></relation><relation name="UMR6074" active="#struct-441569" type="direct"></relation></listRelation><tutelles><tutelle active="#struct-172265" type="direct"><org type="institution" xml:id="struct-172265" status="VALID"><orgName>Université de Bretagne Sud</orgName><orgName type="acronym">UBS</orgName><desc><address><addrLine>BP 92116 - 56321 Lorient cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-ubs.fr/</ref></desc></org></tutelle><tutelle name="UMR6074" active="#struct-441569" type="direct"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Lorient</settlement><region type="region" nuts="2">Région Bretagne</region></placeName><orgName type="university">Université de Bretagne-Sud</orgName><orgName type="institution" wicri:auto="newGroup">Université européenne de Bretagne</orgName></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="mix" xml:lang="en"><term>MEDIA</term><term>Sopken language understanding</term><term>Wizard of Oz</term><term>dialogue system</term><term>evaluation campaing</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">The aim of the MEDIA-EVALDA project is to evaluate the understanding capabilities of dialog systems. This paper presents the MEDIA protocol for speech understanding evaluation and describes the results of the June 2005 literal evaluation campaign. Five systems, both symbolic or corpus-based participated to the evaluation which is based on a common semantic representation. Different scorings have been performed on the system results. The understanding error rate, for the Full scoring is, depending on the systems, from 29% to 41.3%. A diagnosis analysis of these results is proposed.</div></front></TEI><affiliations><list><country><li>France</li></country><region><li>Grand Est</li><li>Lorraine (région)</li><li>Provence-Alpes-Côte d'Azur</li><li>Région Bretagne</li></region><settlement><li>Avignon</li><li>Lorient</li><li>Metz</li><li>Nancy</li></settlement><orgName><li>Université d'Avignon</li><li>Université de Bretagne-Sud</li><li>Université de Lorraine</li><li>Université européenne de Bretagne</li></orgName></list><tree><country name="France"><noRegion><name sortKey="Bonneau Maynard, H" sort="Bonneau Maynard, H" uniqKey="Bonneau Maynard H" first="H" last="Bonneau-Maynard">H. Bonneau-Maynard</name></noRegion><name sortKey="Ayache, C" sort="Ayache, C" uniqKey="Ayache C" first="C" last="Ayache">C. Ayache</name><name sortKey="Bechet, F" sort="Bechet, F" uniqKey="Bechet F" first="F" last="Bechet">F. Bechet</name><name sortKey="Denis, Alexandre" sort="Denis, Alexandre" uniqKey="Denis A" first="Alexandre" last="Denis">Alexandre Denis</name><name sortKey="Kuhn, A" sort="Kuhn, A" uniqKey="Kuhn A" first="A" last="Kuhn">A. Kuhn</name><name sortKey="Lefevre, F" sort="Lefevre, F" uniqKey="Lefevre F" first="F" last="Lefevre">F. Lefevre</name><name sortKey="Mostefa, D" sort="Mostefa, D" uniqKey="Mostefa D" first="D" last="Mostefa">D. Mostefa</name><name sortKey="Quignard, M" sort="Quignard, M" uniqKey="Quignard M" first="M" last="Quignard">M. Quignard</name><name sortKey="Rosset, S" sort="Rosset, S" uniqKey="Rosset S" first="S" last="Rosset">S. Rosset</name><name sortKey="Servan, Christophe" sort="Servan, Christophe" uniqKey="Servan C" first="Christophe" last="Servan">Christophe Servan</name><name sortKey="Villaneau, J" sort="Villaneau, J" uniqKey="Villaneau J" first="J" last="Villaneau">J. Villaneau</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 005113 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 005113 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Main
|étape= Exploration
|type= RBID
|clé= Hal:hal-01160167
|texte= Results of the French Evalda-Media evaluation campaign for literal understanding
}}
| This area was generated with Dilib version V0.6.33. |  |